Robotic device tester

ABSTRACT

A system, method, and device may include software and hardware which simplify and quicken configuration of the system for testing a device, enhance testing procedures which may be performed, and provide data via which to easily discern a cause and nature of an error which may result during testing. A camera may capture still images of a display screen of a tested device and another camera may capture video images of the tested device and a partner device. A wizard may be used to generate a configuration file based on one previously generated for a similar device. A mount for a tested device may be structured so that: it is suitable for mounting thereon a plurality of differently structured devices; and adjustments in a vertical direction and a horizontal direction in a plane and adjustments of an angle of the device relative to the plane may be easily made.

CROSS-REFERENCE TO RELATED APPLICATION

The present application is a continuation of and claims priority to U.S.Provisional Patent Application No. 61/046,355, filed on Apr. 18, 2008,entitled “Robotic Device Tester,” and U.S. NonProvisional patentapplication Ser. No. 12/239,271, filed on Sep. 26, 2008, entitled“Robotic Device Test,” each of which, including all disclosures andspecifications of which, are hereby expressly incorporated herein intheir entireties by reference thereto.

BACKGROUND

Numerous devices, and particularly handheld communication devices, suchas mobile telephones, are often manufactured and updated. Each suchdevice requires testing of the device's hardware, software, andcommunications functionality during and subsequent to the developmentand design of the device and prior to large scale production anddistribution of the new device or of new software to run on a new orlegacy device.

Conventional testing systems expose and access internal interfaces of atested device in order to simulate operation of the device according topredetermined test sequences that have been input. However, suchoperation of the tested device is insufficient since it does notaccurately reflect how the device is ultimately used, i.e., by buttonpresses or actuation of other input hardware, such as scroll bars,wheels, or joy sticks. Further, in case of a failure, an operator mayhave difficulty determining, e.g., for troubleshooting purposes, theprecise failure or its cause if the failure occurs during a longunattended test run. Additionally, with respect to communications, thetest is incomplete because communication results at a receiving device,to which a communication from the tested device is transmitted duringthe test, are unknown and because receipt by the tested device of acommunication from another device is not tested.

Other conventional testing systems provide a robotic arm for performingbutton presses to simulate use of the tested device. A camera maycapture screenshots or short videos of the tested device during the testsequence which may be helpful for troubleshooting. However, even thesesystems are deficient because of their inability to allow fordetermining results at another receiving device and their inability totest the tested device's functionality upon receipt of a communicationfrom another device.

Additionally, conventional testing systems require tedious and detailedconfiguration and calibration for each different tested device. This isfurther exacerbated when a first tested device is removed from thetesting system, e.g., to fix a glitch, and then returned to the testingsystem after testing of a second tested device, for which the testingsystem was configured after the initial test of the first tested device.This scenario would require a second configuration of the testing systemfor the second test of the first tested device.

SUMMARY

Embodiments of the present invention provide a device, system, andmethod that address each of the deficiencies described above withrespect to conventional device testing systems. Embodiments of thepresent invention may be applied to both hardware and software stresstesting. A device testing system may include a robotic arm for operatinga tested device and may include an arrangement for operating a secondnon-tested device to communicate with the tested device, includingtransmitting messages or initiating a call to the tested device. A firstcamera may be provided for recording snapshots of a display screen ofthe tested device and a second camera may be provided for capturingvideos of the tested device as a whole and the second non-tested device,both of which being in the viewing range of the second camera.

The above functionality may be a primary utilization of the first andsecond cameras. In an alternative example embodiment, however, bothcameras take snapshots, both cameras take video, or both cameras takeboth snapshots and video. In yet another alternative example embodiment,the first camera takes video while the second camera takes snapshots.

A wizard may be included for facilitating a quick configuration of thetesting system for each tested device. The wizard may reference apreviously stored set of input test scenarios for application to varioustested devices. The wizard may further refer to configuration filesassociated with a previously tested device for generating a newassociation of some or all of the files with a new tested device. Thefiles newly associated with the new tested device may be furthermodified to customize the files to the features of the new testeddevice.

Configuration of the testing system may include recordation of threedimensional coordinates for each or one or more buttons or other inputdevices, e.g., joy stick, trackball, thumbwheel, switch, etc., of thetested device. Two of the coordinates may represent a two-dimensionalposition of the input device on a plane of the tested device. The thirdcoordinate may represent a position to which the input device is to bemoved, e.g., in a direction perpendicular to the two-dimensional plane,in order for the tested device to register actuation of the input deviceand to do so without over-extending the input device or a plane of thetested device, e.g., by too hard of a button press. For an input deviceof the tested device for which the three dimensional coordinates are tobe recorded, after coordinates representing a two-dimensional plane areinput, the device testing system may automatically determine and recordthe coordinate of the third dimension based on signals obtained from aforce sensor during movement of the robotic arm in the directionperpendicular to the input plane.

The device testing system may include a single main workstation in whichto perform the testing configuration and to perform the subsequenttesting. The device testing system may also include a second workstationwhich may be less complex than the main workstation, e.g., by omissionof some of the software and/or hardware, such as omission of the roboticarm. According to this embodiment, some of the configuration of thedevice testing system for testing the tested device may be performedusing the second less complex workstation. This may be advantageoussince it may provide flexibility such as to allow for collaboration by agroup of operators for performing the configuration, each operator at aseparate location, e.g., at the operator's own desk or at home, insteadof at a main testing location at which the main workstation is located.It may be required to perform some of the configuration steps using themain workstation. Subsequent to the configuration, the tested device maybe transferred to the main workstation for testing according to theconfiguration, part of which may have been performed at the secondarylocation.

According to an example embodiment of the present invention, for eachtested device for which the device testing system is configured, aunique code may be stored. The code may be associated with aconfiguration file to be used for testing of the tested device. At anytime, the device testing system may be reconfigured for a previouslytested device by input of the code. Further, so as to allow for quickreconfiguration without any user input, each code may encoded in barcodeformat. Each tested device or a fixture to which the device is attachedfor the testing of the device may be marked by the barcode. At thebeginning of a test sequence, a camera of the testing device may capturean image of the tested device and/or fixture, match the barcode to onestored in a testing system, e.g., in a database or other file structure,such as a directory tree of phone configurations, and automatically loadthe configuration associated with the imaged barcode.

According to an example embodiment of the present invention, a devicefixture includes an attachment plate having: a middle bore extendingtherethrough; and, on each of at least two sides of the middle bore, arespective lip, at least a portion of the lip extending along at least aportion of the bore on at least two sides of the bore. The devicefixture further includes a base including a wide base and a narrow baseabove the wide base, the base slidably coupled to the attachment plate,the wide base extending underneath the at least two lips and the narrowbase extending between the at least two lips. The device fixture furtherincludes a first vertical plate extending upward from a surface of thenarrow base which is parallel to a surface of the attachment platethrough which the two elongated bores and the middle bore extends, thefirst vertical plate having at least two bores extending from a surfaceof the first vertical plate and in a direction perpendicular to adirection in which the first vertical plate extends from the narrowbase. The device fixture further includes a second vertical platehaving: a curved bore extending therethrough and being slidablycoupleable to the first vertical plate via coupling into the at leasttwo bores of at least two fasteners extending through the curved bore;and a structure having a shape and extending from a surface of thesecond vertical plate that is, when the second vertical plate is coupledto the first vertical plate, parallel to the surface of the narrow basefrom which the first vertical plate extends. The device fixture furtherincludes a mounting plate having: a first bore in a shape thatcorresponds to the shape of the structure of the second vertical plate,the structure of the second vertical plate being slidably receivableinto the first bore of the mounting plate for coupling of the secondvertical plate to the mounting plate; and at least one second boreextending from a surface of the mounting plate that is, when themounting plate is coupled to the second vertical plate and the secondvertical plate is coupled to the first vertical plate, perpendicular tothe surface of the narrow base from which the first vertical plateextends, and to the first bore, the coupling of the mounting plate tothe second vertical plate being tightenable insertion of at least onefastener through the at least one second bore to the structure of thesecond vertical plate extending through the first bore.

In an example embodiment, the device fixture further includes a baseplate having a plurality of bores extending from a surface of the baseplate, where the attachment plate has two elongated bores extendingthrough the attachment plate, each of the elongated bores at arespective one of two opposite sides of the attachment plate, the middlebore extending between the two elongated bores, and where the attachmentplate is coupleable via coupling into two of the plurality of bores oftwo respective fasteners extending respectively through respective onesof the two elongated bores in a direction perpendicular to the surfaceof the narrow base from which the first vertical plate extends.

In an example embodiment of the described device fixture, the shape ofthe structure is an elongated T shape.

In yet a further variant of the immediately preceding exampleembodiment, the at least one second bore includes three bores.

In an example embodiment, the device fixture further includes anadhesive on a surface of mounting plate that is perpendicular to thesurface from which the at least one second bore of the mounting plateextends and that is, when the mounting plate is coupled to the secondvertical plate and the second vertical plate is coupled to the firstvertical plate, parallel to the surface of the narrow base from whichthe first vertical plate extends.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 a is a diagram showing components of a system according to anexample embodiment of the present invention.

FIG. 1 b is a diagram showing components of a system according to anexample embodiment of the present invention.

FIG. 2 is a diagram showing a robot arm and plate according to anexample embodiment of the present invention.

FIGS. 3 and 4 show exemplary embodiments of the present invention inwhich a tested device and partner device may be placed in closeproximity during a test.

FIG. 5 shows components of a device fixture base plate and a barcodeaccording to exemplary embodiments of the present invention.

FIG. 6 shows components of a robot according to an example embodiment ofthe present invention.

FIG. 7 shows components of a disassembled device fixture according to anexample embodiment of the present invention.

FIG. 8 shows the device fixture of FIG. 7 in its assembled state,according to an example embodiment of the present invention.

FIG. 9 shows a post which may be used to prevent torquing of a testeddevice, according to an example embodiment of the present invention.

FIG. 10 is a diagram that illustrates a mini workstation according to anexample embodiment of the present invention.

FIG. 11 is a screenshot showing an exemplary file structure forconfiguration files, according to an example embodiment of the presentinvention.

FIG. 12 is a cross-functional flowchart that illustrates a methodaccording to which a device may be tested, including generation of aconfiguration file and performance of the test, according to an exampleembodiment of the present invention.

FIG. 13 is a flowchart that illustrates a method of generating a partialconfiguration file, e.g., at a mini workstation according to an exampleembodiment of the present invention.

FIG. 14 is a flowchart that illustrates a method of completing aconfiguration file, according to an example embodiment of the presentinvention.

DETAILED DESCRIPTION

FIG. 1 a shows a device testing system 1 according to an example of thepresent invention. The device testing system 1 may include a compartment100 which may house a robot 102, a platform 104, a user terminal 105, alight fixture 110, and a camera arrangement 111. The robot 102 mayincludes an arm 103 to operate a tested device 115. As used herein, theterm tested device does not necessarily mean that the device iscurrently undergoing a test, but rather means that the device is one forwhich the system 1 is configurable to perform a test. In certaincontexts, however, the tested device 115 may be described as undergoinga test.

The compartment 100 may be fully enclosed during configuration of thedevice testing system 1 and/or testing of the tested device 115 so thatlighting may be controlled to be at an optimum level at various stagesof the configuration and/or testing.

The platform 104 may include attachment point at which to attach adevice fixture 114 upon which the tested device may be fixedly, e.g.,via an adhesive, mounted. The platform 104 may, for example, includerecesses into which pegs extending from a bottom surface of the devicefixture 114 may be inserted for ensuring that the device fixture 114 isplaced in the same position with respect to the robot 102 each time thedevice fixture 114 is placed for testing of the mounted tested device115.

During configuration and/or testing, the tested device 115 may bepositioned with respect to the device testing system such that a planeof the tested device 115 that includes a display screen is perpendicularto a direction in which the arm 103 extends towards the platform 104 tooperate the tested device 115. Where a portion of the tested device 115which include the majority of user operable input devices, e.g., akeypad, is coupled to the portion including the display screen, e.g., ina hinged manner, such that, in an open position of the tested device115, the keypad portion is arranged at a less or greater than 180° anglerelative to the display screen portion, it may be required for the arm103 to extend to substantially different positions in the directionperpendicular to the plane of the platform 104 to operate differentbuttons of the tested device 115.

The arm 103 may be attached to a main body of the robot 102 via an armplate 140 more clearly shown in FIG. 2, such that the arm 103 islaterally displaced from a vertical axis of the main body of the robot103. Such displacement may provide for cameras of the camera arrangement111 a better view of the tested device 115 during configuration and/ortesting.

As shown in FIG. 1 b, the camera arrangement 111 may include a firstcamera 113 and a second camera 112. In an example embodiment of thepresent invention, the second camera 112 is angled such that an axisextending perpendicularly through its lens extends towards the platform104 at a non-perpendicular angle and whose settings may be such that itsfield of view encompasses the entire tested device 115. A display screenof the tested device 115 may be laterally shifted from an axis extendingperpendicularly through the lens of the second camera 112 towards theplatform 104. Further, the portion 115.a of the tested device 115including the display screen may be at an angle relative to the axisextending through the lens of the second camera 112, where the angle isnot 90°.

In an example embodiment of the present invention, the first camera 113is arranged such that its lens is approximately parallel to the platform104 and therefore approximately parallel to the surface of the displayscreen of the tested device 115. Further, the camera 113 and the devicefixture 114 may be positioned relative to each other such that an axisextending perpendicularly through the lens of the camera 113 extendsapproximately perpendicularly through the display screen of the testeddevice 115, e.g., through a center of the display screen. The displayscreen of the tested device 115 may thus be in better focus and beviewed with greater resolution by the first camera 113 than by thesecond camera 112, so that, while the second camera 112 may recordimages, e.g., moving images, of the entire tested device 115, the firstcamera 113 may record images in which the display screen may be moreclearly depicted to allow for processing by image recognition software,including, for example, optical character recognition (OCR), of theimage of the display screen. In an example embodiment, the zoom settingof the first camera 113 may be such that the display screen entirely orapproximately entirely encompasses the field of view of the first camera113.

The device fixture 114 may be configured to allow for mounting thereonof the tested device 115 and a partner device 116 (which may itselfoccupy the role of a tested device and may be tested during a differenttesting operation of the system 1) in close proximity to the testeddevice 115 as shown in the two exemplary embodiments of FIGS. 3 and 4.The camera 112 may be arranged and the settings of the camera 112 may beconfigured such that the tested device 115 and the partner device 116may be within the field of view of the camera 112, so that the recordedimages generated by the camera 112 may be simultaneously of both thetested device 115 and the partner device 116.

The user terminal 105 may include a processor 106, a memory 107, adisplay 108, and an input device 109. The processor 106 may include anysuitable conventional processing circuit implemented in any conventionalform, such as a Central Processing Unit (CPU) of a Personal Computer(PC). The memory 107 may include any suitable conventional memorydevice, such as Random Access Memory (RAM), Read Only Memory (ROM), ahard disk, magnetic tape, a Compact Disk (CD), Flash Memory baseddevice, and/or a Digital Versatile Disk (DVD). The memory 107 mayinclude program instructions executable by the processor 106 to performthe various functions described herein for configuring and operating thesystem 1 and for operating the partner device 116 in the variousexemplary ways described herein.

In an example embodiment of the present invention, the processingcircuit may include a robot controller PC and a Test Executive PC(TEPC), where both PCs are connected to an Ethernet switch in thestation, and they communicate over a local network. The TEPC sendsbutton push and other commands to the robot controller PC, which hassoftware running on it to listen to and act upon the commands. Thedisplay and input device are common to both the TEPC and the robotcontroller PC, connected by a KVM switch.

The tested device 115 and the partner device 116 may each be acommunications device, such as a mobile phone. The processor 106 may beconnected to the partner device 116, e.g., via a communications/controlinterface, for example a serial interface, of the partner device 116. Inan example embodiment, the partner device is connected to the TEPC.During testing of the tested device 115, the processor 106, e.g., TEPC,executing partner device instructions 120 in the memory 107, e.g., aportion of the instructions 120 which resides in a part of the memory107 which the TEPC processor accesses, may input commands to the partnerdevice 116 via the serial interface of the partner device 116. Thecommands may simulate operation of input hardware of the partner device116 which causes the partner device 116 to transmit a communication tothe tested device 115.

In an example embodiment of the present invention, the processor 106,e.g., TEPC, may also intercept data of the partner device 116 used forgenerating a display in the display screen of the partner device 116.Where, during testing of the tested device 115, the tested device 115 isoperated to transmit a communication to the partner device 116, theprocessor 106, e.g., TEPC, may analyze the intercepted data from thepartner device 116 to determine whether the appropriate result for theexpected communication from the tested device 115 was obtained bycomparing the intercepted data with expected data stored in the memory107, e.g., TEPC memory. If the result is not what was expected, theprocessor 106 may determine that an error has occurred. Similarly,where, during a part of the testing of the tested device 115, the testeddevice 115 was not to have communicated with the partner device 116, theprocessor 106, e.g., TEPC, may determine that an error has occurredwhere non-expected data is intercepted from the partner device 116.

In an example embodiment of the present invention, the processor 106,e.g., TEPC, may be coupled to the cameras 112 and 113. The processor106, e.g., TEPC, may receive images sensed by a sensor of the camera 113which captures light passing through the lens of the camera 113. Theprocessor 106, e.g., TEPC, may execute image processing software 121 tocompare the images received from camera 113 to images of a displayscreen image collection 122, e.g., stored in the memory of the TEPC, todetermine whether the images received from the camera 113 match theimages of the collection 122, e.g., stored in the memory of the TEPC.For each of the images of the collection 122, e.g., stored in the memoryof the TEPC, the collection 122 may identify the particular respectiveoperation(s) of the tested device 115 with which the image isassociated. For each such identified one or more operations, uponperformance by the robot 102 of the identified operation(s), theprocessor 106, e.g., TEPC, may compare the image captured by the camera112 immediately following performance of the operation(s) with the imageassociated with the performed operation(s).

While the camera 113 provides images to the user terminal 105, thecamera 112 may also provide images to the user terminal 105. The imagesprovided by the camera 112 may be moving images, i.e., movies. Themoving images may be stored in a buffer of the memory 107, e.g., of theTEPC. In response to a determination by the processor 106, e.g., TEPC,that an error has occurred, the processor 106, e.g., TEPC, may transfera number of the images in the buffer to a permanent memory location,images of which are playable as a movie, e.g., on display 108. In anexample embodiment of the present invention, the images which aretransferred are those encompassing a time period beginning shortlybefore the occurrence of the error and ending shortly after theoccurrence of the error.

In an example embodiment of the present invention, the buffer may beconfigured as a First-In-First-Out (FIFO) memory and to hold only asmall number of images. Once full, for each newly received image, theimage of the FIFO which was received prior to all other images of theFIFO may be deleted and the newly received image may be written into theFIFO. In an example embodiment, all of the images of the FIFO oracquired images in the form of a video may be transferred to permanentstorage upon detection of an error. Alternatively the number of imagesof the temporary memory which are transferred to permanent storage maybe based on a predetermined number or a predetermined time interval withwhich the processor 106, e.g., TEPC, is configured. It is noted that thenumber of recorded image frames which represent a time interval mayvary, e.g., if the frame capture rate of the camera 112 varies.Alternatively, all images may be grabbed and saved to a file on thelocal disk. Upon detection of an error, a number of images may be storedat a separate memory location for viewing of the error. In yet anotheralternative, all images are stored to a temporary file which is deletedif no error occurs and permanently stored if an error is detected. Bythe conditioning of permanent storage of images upon error detection asdescribed with respect to these embodiments, the required storagecapacity may be reduced because, for example, full length video of everyrun from start to finish is not stored.

In an example embodiment of the present invention, the memory 107, e.g.,on the TEPC, may include a configuration file database 123 whichincludes a respective configuration file or folder for each testeddevice 115 for which the system 1 is configured. In an exampleembodiment of the present invention, where some of tested devices 115are very similar, such that configuration of the system 1, with respectto the operations to be performed during the testing of the devices andthe location of the input hardware of manipulated by the robot 102during the test are identical, those similar tested device 115 may sharea same one of the configuration file or folder. In an alternativeexample embodiment, regardless of similarity of features, no two testeddevices, e.g., phones, share the same configuration file, but rathereach have a unique configuration file/folder structure. For eachdifferent configuration file or folder, a unique code may be generatedby the processor 106. Alternatively, a separate PC outside the robotstation may generate and/or print the code. The code may be codable,e.g., in a barcode. In an example embodiment of the present invention, acode, e.g., a barcode, may be placed on a tested device 115 or on thedevice fixture 114. FIG. 5, for example, shows a barcode 500 placed onthe device fixture 114 near the tested device 115 with respect to anaxis extending perpendicularly through lens of the camera 112 so thatthe barcode 500 is in the field of view of the camera 112 when thedevice fixture 114 is mounted on the platform 104 in the testingposition.

Upon initialization of the system 1 for performing a test, the processor106, e.g., TEPC, may operate the camera 112 to obtain an image. Theprocessor 106, e.g., TEPC, executing the image processing software 121,e.g., stored on the TEPC, may detect the barcode 500 in the obtainedimage, process the barcode 500 to determine its underlying code, comparethe underlying code with a set of codes stored in the memory 107, selectthe configuration file or folder associated with the code, and beginoperating the robot 102 according to the configuration parametersincluded in the configuration file or folder to perform the testingsequences outlined in the configuration file or folder.

If a barcode is not detected, the processor 106, e.g., TEPC, may,according to different exemplary embodiments, cause the display 108 tooutput an error message, output a message requesting a user to manuallyinput, via the input device 109, the code, or output a messagerequesting the user to begin a process for generation of a newconfiguration file or folder. In an example embodiment of the presentinvention, the processor 106, e.g., TEPC, may cause the display of anerror message indicating that no barcode is included (or that anincluded barcode is not recognized), and requesting input indicatingwhether a configuration file exists which may be used for the mountedtested device 115. If the user indicates that a configuration fileexists, the user may be prompted to enter the code. If the userindicates that a configuration does not yet exist, the user may beprompted to begin the process for generation of the configuration fileor folder.

In an alternative example embodiment, the user is prompted forgeneration of a configuration file or folder only if: (a) no barcode isfound; or (b) a barcode is found and no configuration data exists forthat phone. The user is not prompted for whether a configuration fileexists, as this is determined programmatically.

In an example embodiment of the present invention, the light fixture 110may include, for example, light emitting diodes (LEDs), e.g., 2 LEDs. Inan example embodiment of the present invention (not shown), there aretwo independently controllable light fixtures, one on each side of thecameras, each light fixture including approximately 6 LEDs. The lightfixture 110 may be configured to produce a plurality of levels of light.The processor 106, e.g., TEPC, may be coupled directly or indirectly tothe light fixture 110 and may be configured to control the light fixture110 according to a light control program 124, e.g., on the TEPC, to varythe light level produced by the light fixture.

In particular, the light fixture 110 may be configured to produce lightat two different light levels. Upon initiating the system 1 to perform atest of the tested device 115, the processor 106, e.g., TEPC, executinga light control program 124 may operate the light fixture 110 to emitlight at a first level and may operate the camera 112 to record an imagewhile the light fixture 110 emits light at the first level. Theprocessor 106, e.g., TEPC, may process the image obtained from thecamera 112 operated while the light fixture emits light at the firstlevel to recognize the barcode 500 (if any is included).

After obtaining the image and/or recognizing the barcode 500 orotherwise determining the code to be used for obtaining the necessaryconfiguration file or folder, the processor 106, e.g., TEPC, may turnoff the light fixture 110 so that it does not emit any light. Theprocessor 106, e.g., executing instructions of a selected configurationfile of the database 123, e.g., the TEPC, may further operate the robot102 while the light fixture 110 is turned off to operate the testeddevice 115 so that the display screen of the tested device 115 is turnedon. The processor 106, e.g., TEPC, may be further configured to executeinstructions in the memory 107, e.g., on the TEPC, for detecting theprecise position and perimeter of the display screen of the testeddevice 115 with respect to the camera 113 based on a contrast betweenthe light produced by the display screen and the non-lit surroundingarea, which contrast is determined by analysis of an image obtained fromthe camera 113 while the light fixture 110 is turned off and the displayscreen is active to produce light. Although the tested device 115 may befixedly mounted to the device fixture 114 and although the position ofthe device fixture 114 with respect to the platform 104 may besubstantially the same each time the fixture 114 is placed on theplatform 104 in position for testing, the display screen finding processmay be performed by the processor 106, e.g., TEPC, because a slightshift of the display screen relative to the camera arrangement 111 maynevertheless occur, which may cause a miscalculation of regions ofinterest (ROIs) used for image processing during the test of the testeddevice 115. For example, such a shift may be caused by slightdifferences in the camera alignments on different copies of the testsystem.

After determining the display screen position relative to the camera113, the processor 106, e.g., TEPC, may control the light fixture 110 toemit light at a second level different than the first level which wasused to read the fixture barcode. The second light level may bemaintained for the remainder of the testing process of the tested device115. In particular the second light level may be lower than the firstlight level so that the display screen emitted light is more pronouncedrelative to the light emitted by the light fixture 110 than it would beif the light fixture 110 would emit light at the first light level.

In an example embodiment of the present invention, the compartment 100may be completely enclosed. At one or more sides, the compartment 100,the enclosure of the compartment may be via an openable door or curtain,so that a user may have access to the interior of the compartment 100.The enclosure of the compartment 100 may allow for precise control ofthe light level within the compartment without being affected by ambientlight from outside the compartment 100.

In an example embodiment of the present invention, the processor 106,e.g., TEPC, may execute a tested device button location training wizard125 stored in the memory 107, e.g., on the TEPC. For example, a user mayinput commands via the input device 109 to cause the processor 106,e.g., TEPC, to load and execute the wizard 125. Instructions of thewizard 125 may cause the processor 106 to prompt the user, e.g., via thedisplay 108, for various data or for manually operating the robot arm103. Responsive to the user input and arm operation, the processor 106may generate a new configuration file or folder of the database 123and/or new sub-files or folders thereof. In an example embodiment of thepresent invention, responsive to the user input and arm operation, nonew files or folders are generated, but rather, an existingconfiguration file is modified to include the trained location of thebuttons.

During execution of the wizard 125, the processor 106, e.g., TEPC, mayprompt the user to input basic software features supported by the newtested device 115. For example, the prompts may be in the form of aseries of “yes and no” questions or checkboxes, each questioning whetherthe new tested device 115 includes a respective basic feature. Anon-exclusive list of exemplary features about which the processor 106may ask includes the support of various tasks such as handling calls,messaging, and/or e-mailing and the types of input hardware included inthe tested device 115, e.g., a camera, and/or the surfaces of the testeddevice 115 on which the respective input hardware is positioned. Theprocessor 106 may then determine whether the database 123 includes aconfiguration file or folder for another device having features similarto those input for the new tested device 115. For example, if a majorityof the features input for the new tested device 115 match the featureinput provided upon configuring the system 1 for another device, theprocessor 106 may determine that the two devices are similar. Further,if more than one other device is determined by the processor 106 to besimilar to the new tested device 115, the processor 106 may select thedevice that is most similar, as determined by the input, to the newtested device 115.

In an alternative example embodiment, the program does not determinewhether two devices are similar. Instead, a user makes thisdetermination and chooses a phone of similar features, if any, as abaseline for modification.

In an example embodiment of the present invention, the processor 106,e.g., TEPC, may initially ask the user to identify a device for whichthe system 1 has been previously configured and which the user believesis most similar to the new tested device 115. If the user identifiessuch a device and the processor 106 finds a configuration file or folderin the database 123 which is associated with the identified device, theprocessor 106 may omit the steps of requesting the user to input thebasic features of the new tested device 115. In an alternative exampleembodiment, there is no omission of steps. All configuration steps arerun through, but less work is required where only modification of abaseline file can be performed instead of generation of configurationfile features from scratch.

If the processor 106 determines that a device associated with aconfiguration file or folder of the database 123 is similar to the newtested device 115 or if the user identifies such a similar device, theprocessor 106 may obtain the associated configuration file or folderfrom the database 123 or other device or phone configuration directoryand generate a copy of the obtained file or folder as a newconfiguration file or folder to be stored in the database 123 or otherdevice or phone configuration directory and to be associated with thenew tested device 115. The folders may be named according the make andmodel of the devices being tested. For example, a folder may be named bymanufacturer, which may include sub-folders, each of which is associatedwith a respective tested device and is named by the respective make ofthe tested device. The make folder may include sub-folders for buttonsequences to be used and for display screen images. The files maycorrespond to the different sequences and the different display screenimages. An example file structure is shown in FIG. 11.

The wizard may automatically populate a configuration file identifyingthe supported features of the tested device 115, including the supportedactions and the included hardware, such as general placement of buttonsand inclusion of a camera. This file may be used to determine which testcases to run for testing the features of the tested device 115.

However, because the configuration file or folder was initiallygenerated for a different device, not all of the settings accuratelyreflect the new tested device 115. Therefore, the wizard may stepthrough a series of display screens with which the user may interact forinputting information regarding the new tested device 115 for itsoperability during a test. The display screens may be initiallypopulated with information reflective of the different device for whichthe configuration file or folder was generated. Wherever the usernotices a discrepancy between the displayed data and that which wouldaccurately reflect the new tested device 115, the user may input thenecessary changes. For example, the user may update a button sequence tobe used for the tested device 115 to accomplish a particular task and/ormay update the display screen image that is displayed on the displayscreen of the tested device 115 at or following a particular event.

Further, if the new tested device 115 includes an added feature forwhich the device for which the previous configuration file does notprovide an equivalent, a new sub-file or sub-element for the addedfeature may be added to the configuration file. Similarly, the processor106, e.g., TEPC, may remove sub-files or sub-elements corresponding tofeatures for which the new tested device 115 does not provide anequivalent.

If the user does not identify a similar device and the processor 106,e.g., TEPC, determines that none of the stored configuration files orfolders (if any) of the database 123 are associated with a devicesimilar to the new tested device, a new configuration file or folder maybe generated from scratch, requiring the user to input all of thenecessary information. In an alternative example embodiment, the user isalways forced to select an existing phone/device, so that the wizardautomatically generates a configuration file for the new device based onthe file of the selected device. For example, an initial configurationfile may be stored when programming the wizard for later generation offiles for devices to be tested.

After customizing the configuration file with respect to the supportedfeatures of the tested device 115, the wizard may step through aplurality of test cases for which the wizard has been previouslyconfigured. During the step through of the test cases, for each case,the wizard may prompt the user to operate the new tested device 115,while it is mounted so that the display screen of the device 115 is inthe field of view of the camera 113, so that the display screen of thenew tested device 115 displays a screen that is to result from therespective test case. Once the resulting screen is displayed, the usermay input an indication that the screen is displayed. The processor 106,e.g., TEPC, may record in the configuration file and in association withthe respective test case an image obtained from the camera 113 which wasrecorded by the camera 113 when the user input the indication that therequested screen was displayed. The processor 106 may compare imagesobtained from the camera 113 during a test of the tested device 115 tothe images of the configuration file associated with the tested device115.

In an example embodiment of the present invention, the processor 106,e.g., TEPC, may initially populate the configuration file with those ofa device identified by the user or the processor 106 as similar to thenew tested device 115 (if any), as described above. The user mayindicate for each test case whether a different display is to beprovided. In an alternative example embodiment of the present invention,new display screens for each new tested device 115 may always berequired to ensure that the processor 106, e.g., TEPC, accounts forslight spatial variations in the display screens.

In an example embodiment of the present invention, the robot 102 mayinclude a force sensor 600 as shown in FIG. 6. The force sensor 600 maysense the force exerted by the arm 103 in a direction perpendicular tothe platform 104 and in a direction parallel to the platform 104. It isnoted that the arm 103 may operate input hardware of the tested device115 by depressing a button on a face of the tested device 115 which isparallel to the platform 104 and may operate input hardware of thetested device 115 by depressing a button on a face of the tested device115 which is perpendicular to the platform 104. In the former scenario,detected force in the perpendicular direction would increase as thebutton is depressed, whereas in the latter scenario detected force inthe parallel direction would increase as the button is depressed.Different parts of the arm 103 may be used for depressing buttonsdepending on the direction in which the buttons are depressed. Forexample, an arm end 601 may be used to depress a button in theperpendicular direction and a side element 602, e.g., formed by a ring,may be used to depress a button in the parallel direction.

In an example embodiment of the present invention, during the generationof the configuration file for the tested device 115, the processor 106,e.g., TEPC, may record coordinates of each input hardware to be operatedby the system 1 during a test of the tested device 115. Based oninformation included in the configuration file indicating the inputhardware included in the new tested device 115, which information isprovided as described in detail above, the wizard 125 may, for eachhardware input device, e.g., button, cause the processor 106, e.g.,TEPC, to prompt the user to manually move the robot arm 103 to aposition which matches the position of the button but on a differentplane than that in which the button is located. For example, for buttonson the face of the tested device 115 which is parallel to the platform104, the user would move the arm 103 so that the arm end 601 is lined upwith the button but is in a plane parallel to but different than theface of the tested device 125 in which the button is located. Forbuttons on a face of the tested device 115 which is perpendicular to theplatform 104, the user would move the arm 103 so that the side element602 is lined up with the button but is in a plane parallel to butdifferent than the face of the tested device 125 in which the button islocated.

For a button on the face of the tested device 115 which is parallel tothe platform 104, once the user inputs an indication that the robot arm103 has been moved to the requested location, the processor 106, e.g.,TEPC, may record in the configuration file the x and y coordinates ofthe arm end 601, where the x coordinate is a position along an axis thatextends along the plane of the platform 104 in a horizontal directionand the y coordinate is a position along an axis that extends along theplane of the platform 104 in the vertical direction. The processor 106,TEPC, may also operate the arm 103 to extend in the perpendiculardirection to depress the button. Once the force sensor 600, which mayprovide its readings to the processor 106, e.g., the robot controllerPC, detects that a predetermined force has been reached, the processor106, e.g., TEPC, may record in the configuration file in associationwith the button a present z coordinate of the arm 103, where the zcoordinate is a position along a plane that extends perpendicular to theplatform 104. For most buttons, the force to be used as thepredetermined force has been determined to be approximately 500 grams.However, different predetermined forces may be used for differentbuttons.

In an alternative example embodiment, once the user inputs an indicationthat the robot arm 103 has been moved to the requested location, theprocessor 106, e.g., TEPC, initially records in the configuration filethe x and y coordinates, as well as an initial z coordinate. After theforce calibration, the z coordinate is updated.

For a button on the side of the tested device 115 which is perpendicularto the platform 104, once the user inputs an indication that the robotarm 103 has been moved to the requested location, the processor 106,e.g., TEPC, may record in the configuration file the z and y coordinates(and, in an example embodiment, an initial x coordinate) of the arm end601. The processor 106, e.g., TEPC, may also operate the arm 103 toextend in the one of the parallel directions (depending on which side ofthe tested device 115 the button is located) to depress the button. Oncethe force sensor 600 detects that a predetermined force has beenreached, the processor 106 may record in the configuration file inassociation with the button a present, e.g., modified, x coordinate ofthe arm 103. During subsequent testing of the tested device 115, theprocessor 106, e.g., TEPC, in accordance with the associatedconfiguration file, may cause the robot arm 103 to move to the recordedx,y,z coordinates to depress the respective button of the tested device115.

During configuration of the system 1 for a new tested device 115, e.g.,during generation or modification of a configuration file for the testeddevice 115, the processor 106, e.g., TEPC, may operate the light fixture110 similar to the manner described above with respect to its operationduring testing of the tested device 115. For example, a barcode may beplace on the device fixture 114 prior to configuration of the system 1for the new tested device 1. When the configuration is initiated, theprocessor 106 may operate the light fixture 110 to emit light at thefirst level in order for the processor 106 to detect the barcode 500.Once detected, the processor 106, e.g., TEPC, may turn off the lightfixture 110 and prompt the user to activate the display screen of thenew tested device 115. Once the processor 106 receives an indicationthat that display screen is active, the processor 106 may determine theprecise position of the display screen relative to the camera 113 by thecontrast of the light of the display screen to the unlit surroundingarea. Subsequent to recording the display screen position, the processor106, e.g., TEPC, may operate the light fixture 110 to emit light at thesecond level. The processor 106 may record the template display screens,as described in detail above, while the light fixture 110 emits light atthe second lighting level.

It is noted that the configuration of the system 1 for a new testeddevice 115 may be interrupted, saved in an unfinished configurationfile, and resumed at a later time. Each time, the configuration isresumed, the processor 106, e.g., TEPC, may re-perform one or more ofthe lighting control steps. For example, each time, the processor 106,e.g., TEPC, may operate the light fixture 110 to emit light at the firstlighting level in order to read the barcode and determine whichconfiguration file to open up for modification. The other light controlsteps may be performed if not all of the display screen templates haveyet been performed. In an example embodiment of the present invention,the first light control step may be omitted, where the user manuallyinputs the code, so that a barcode need not be read. In an exampleembodiment, the system always attempts to read a barcode and, where thereading is unsuccessful, prompts the user to configure a new device,e.g., phone.

In an example embodiment of the present invention, the system 1 mayinclude a mini workstation 100, e.g., as shown in FIG. 10, forperforming a significant portion of the configuration of the system 1for a new tested device 115. For example, the mini workstation 100 maybe used to perform all of the configuration, except for the recordationof input hardware coordinates. Many of the components of the mainworkstation in which testing and configuration of the input hardwarecoordinates is performed may be omitted in the mini workstation 100. Forexample, one or more or all of the robot 102, the partner deviceinstructions 120, parts of the configuration wizard 125 that are usedfor inputting input hardware coordinates, and most of the imageprocessing software (but for, e.g., that used for recognizing thebarcode 500) may be omitted in the mini workstation 100. In an exampleembodiment, much of the software of the main workstation may be includedin the mini workstation 100 as a large portion of the same software maybe required for acquiring template images at the mini workstation 100.Portions of the configuration file associated with the new tested device115, e.g., any portion besides for input of input hardware coordinates,may be generated and modified at the mini workstation 100. The miniworkstation may include a light fixture 110 and a camera arrangement 111as described above with respect to the main workstation, each of whichmay be operated as described above with respect to the main workstation.Although not shown in FIG. 10, the mini workstation may include or beconnectable to a user terminal including a processor, input device, andoutput device, for a user to control the processor to operate the deviceand to generate and/or modify a configuration file. Further, while notshown in FIG. 10, the compartment 1102 of the mini workstation 100 inwhich the tested device 115 may be placed for configuration of thesystem 1 may include walls, doors, and/or curtains, for enclosing thecompartment 1102 for increased control of lighting conditions within thecompartment 1102.

The mini workstation 100 provides the flexibility of allowing many usersto collaborate by performing different parts of the configuration, e.g.,simultaneously and/or at many locations.

At any time, configuration may be halted and subsequently resumed at themini workstation 100 or at the main workstation. The tested device 115,mounted on the device fixture 114, may be transferred to the mainworkstation for running an actual test on the tested device 115 or formodifying the configuration file to include the data specifying inputhardware coordinates. A user has the option of using only the mainworkstation for all of the configuration and testing.

In an example embodiment of the present invention, different testsequences may be used for different tested devices 115. Theconfiguration file associated with a tested device 115 may identify thetest sequences to be applied to the respective tested device 115 whentesting the tested device 115. The processor 106, e.g., a combination ofthe TEPC and the robot controller PC, may operate the robot 102 during atest according to the test sequences of the associated configurationfile. The processor 106 may also interface with the partner device 116in accordance with the test sequences included in the configuration filein order to control the partner device 116 to communicate with thetested device 115.

In an alternative example embodiment, the test sequences are not locatedin the configuration file or in the phone configuration directory, butare instead designed to be generic to be applied to all devices. Theconfiguration, reference image, and custom button sequence files in thePhone Config directory are referenced in the test sequences toaccomplish this by isolating the devices' operating uniqueness from thegeneric test sequences. Since the partner device 116 is a constant,files governing its control are stored outside of the Phone Configdirectory.

FIG. 12 illustrates a process according to which a device may be tested,including generation of a configuration file and performance of thetest, according to an example embodiment of the present invention. Atstep 1200, a processor of a mini workstation may automatically turnlights on at a first level. At step 1202, a barcode may be detectedusing a camera of the mini workstation while the lights are at the firstlevel. At 1204, the processor may automatically turn off the lights.While the lights are turned off, the processor may, at 1206, detect aposition of the display screen of the tested device with respect to thecamera. At 1208, the processor may automatically turn the lights on at asecond level. At 1210, the processor may generate part of aconfiguration file to be associated with the detected barcode. Exemplarydetails of the generation of the configuration file are illustrated inFIG. 13.

At 1212, steps 1200-1208 may be repeated at the main workstation. Inaccordance with the detection of the barcode (1202) at the mainworkstation, the configuration file associated with the barcode may beselected. At 1214, the configuration file may be completed. FIG. 14illustrates exemplary details of the completion of the configurationfile.

At 1216, the tested device and a partner device may be operatedaccording to the configuration file and according to stored testsequences. For example, the tested device may be operated using arobotic arm, while the partner device may be operated via an interfaceto the partner device. If the operation of the devices for the test isseparated from the completion of the generation of the configurationfile, e.g., by the powering down of the main workstation or the use ofthe main workstation for configuring or testing another device, steps1200-1208 may be repeated prior, e.g., immediately prior, to 1216.

At 1217, video images of the tested and partner devices may be capturedusing one camera. At 1218, still images of the tested device may beobtained using another camera and still images and/or text on thedisplay of the partner device may be obtained via the interface to thepartner device. At 1220, the processor may compare the captured stillimages to stored images. At 1222, whether an error has occurred may bedetermined based on the comparison. If an error has occurred, theprocessor may, at 1226, store the captured still images and/or the videoimages in permanent storage. If an error has not occurred or subsequentto 1226, if the test sequences have not yet been completed (N branch of1224), the process may continue from 1216. Otherwise, the process mayend.

FIG. 13 shows some details of step 1210 according to an exampleembodiment of the present invention. At 1300, the processor may outputprompts for input of device features. At 1302, the processor may comparefeatures input in response to the prompts to those of other devicesincluded in other configuration files associated with those otherdevices. If a device is determined to be similar based on thecomparison, the processor may, at 1304, obtain the configuration filesassociated with the similar device and copy it as a new configurationfile associated with the tested device. If a similar device is notfound, the processor may, at 1303, generate a new configuration file.Subsequently, the processor may, at 1306, update the configuration fileassociated with the tested device responsive to user input and inaccordance with a task file which indicates tasks to be performed duringa test, as described in detail above. In an example embodiment, 1306 mayinclude a repeat performance of 1300 to step through each of the devicefeatures for further customization.

In an alternative example embodiment, the process begins at 1302 with auser manually comparing features of a device to be tested with featuresof other devices. At 1304, the user selects a comparison device and theprocessor obtains and copies a configuration file of that device. Theprocess then proceeds from 1304 to 1300 at which the processor mayprompt for input of device features to modify the copied configurationfile to customize it for the new device at 1306. This alternativeembodiment may also omit the decision and step 1303, as the system mayalways require selection of an already stored configuration file whenusing the set-up wizard. Thus, according to this alternative embodiment,the sequence of the method is 1302 to 1304 to 1300 to 1306.

FIG. 14 shows some details of step 1214 according to an exampleembodiment of the present invention. At 1400, the processor may output aprompt instructing to move the robotic arm so that it is positioned at atwo-dimensional coordinate of a plane parallel to a plane in which abutton is located, where the two-dimensional coordinate corresponds tothe two-dimensional coordinate of the button in its plane. Once at thelocation, the processor may, at 1402, cause the robotic arm to extendtowards the button. At 1404, a force sensor may sense force at the tipof the robotic arm and provide the reading to the processor, e.g., robotcontroller PC. At 1406, the processor, e.g., robot controller PC maycompare the sensed force to a predetermined force value. If the forcevalue has not yet been reached, the process may continue again from1402. Otherwise, the processor may, at 1408, record thethree-dimensional coordinate of the robotic arm for the button. Theprocess may be repeated for all buttons. Once the coordinates have beenrecorded for all of the buttons, the process may end.

In an example embodiment of the present invention, the steps of FIG. 14are divided into two separate loops. In a first loop, step 1400 isperformed for all buttons. At 1400, once the arm is at the instructedlocation, the processor records a two-dimensional coordinate of thebutton. In an alternative example embodiment, the processor mayinitially record an initial three-dimensional coordinate of the button,which is then modified at step 1408. In a subsequent loop, steps1402-1408 are performed for all of the buttons.

An example embodiment of the present invention is directed to aprocessor, which may be implemented using any conventional processingcircuit, to execute code provided, e.g., on a hardware-implementedcomputer-readable medium, to perform any one of the processing, alone orin combination, features described above, including control of otherhardware components.

An example embodiment of the present invention is directed to ahardware-implemented computer-readable medium having stored thereoninstructions executable by a processor to perform any one of theprocessing, alone or in combination, features described above, includingcontrol of other hardware components.

An example embodiment of the present invention is directed to a methodwhich includes the step of transmitting instructions executable by aprocessor to perform any one of the processing, alone or in combination,features described above, including control of other hardwarecomponents.

In an example embodiment of the present invention, a device fixture 114may be provided such that it has a small footprint in order to allow forplacement of the tested device 115 and the partner device 116 in closeproximity. The device fixture 114 may also be constructed in a mannerthat allows for quick, easy, and convenient adjustment of the positionof the tested device 115 with respect to the robot 102 and/or cameraarrangement 111. In particular, as noted above, it is advantageous toarrange the tested device 115 such that the display screen of the testeddevice 115 is substantially parallel to the platform 104 and in goodview and focus of the camera 113. Further, the device fixture 114 may besuch that it may accommodate many different types of tested devices 115having different structures, without requiring difficult customization.FIG. 7 shows the components of an exemplary device fixture 114, otherthan a base plate to which the illustrated components may be attached,which may provide all of these described advantages. FIG. 8 shows theexemplary device fixture 114, other than the base plate, in itsassembled state.

The device fixture 114 may include an attachment plate 700, a base 702which may include a wide base 703 and a narrow base 704, a firstvertical plate 705, a second vertical plate 706, and a mounting plate750. The device fixture of FIGS. 7 and 8 may be fixed to a base plate900 shown in FIG. 5.

The attachment plate 700 may have a respective elongated bore 701running though each of two sides. Screws 720 may be extended through theelongated bores 701 into threaded bores 902 of the base plate 900 forthreaded coupling thereto in order to secure the components illustratedin FIGS. 7 and 8 to the base plate 900. Because of the perpendicularextension of the length of the screws 720 through the elongated bores701, the attachment plate 700 may be shifted with respect to the baseplate 900 by a distance equal to a length of the elongated bores 701minus the thickness of the screws 720, at least until the screws aresubstantially tightened in the bores 902.

The attachment plate 700 may also include a window 710 formed in asubstantial portion of the attachment plate 700 between the elongatedbores 701. The base 702 may slide within the window 710 in a directionperpendicular to the direction in which the attachment plate 700 may beshifted with respect to the base plate 900 after the coupling of thescrews 720 extending through the elongated bores 701 to the bores 902,at least until substantial tightening of the screws 720 in the bores902. Withdrawal of the base 702 from the attachment plate 700 via thewindow 710 may be prevented by contact of the wide base 703 with a lip715 of the attachment plate 700. A thickness 708 of the wide base 703may be greater than a height 709 of the lip 715 from the bottom of theattachment plate 700 in which the wide base 703 may slide. Accordingly,once the screws 720 are sufficiently tightened in the bores 902, thecompressive force of the attachment plate 700 upon the wide base 703,due to the disparity between the thickness 708 of the wide base 703 andthe height 709, may prevent the base 702 from sliding with respect tothe attachment plate 700. Alternatively, the thickness 708 and height709 may be equal, and tightening of the screws may generate a frictionalforce which prevents the sliding of the base 702 with respect to theattachment plate 700.

The first vertical plate 705 may include a number of bores 730, e.g.,two bores 730, which may extend through the first vertical plate 705 ina direction perpendicular to the direction in which the base 702 slidesrelative to the attachment plate 700. The second vertical plate 706 mayinclude a curved bore 707 therethrough. Screws may be extended throughthe curved bore 707 and into the bores 730 for threaded couplingthereto, in order to couple the second vertical plate 706 to the firstvertical plate 705. Prior to substantial tightening of the screwsextending into the bores 730, the second vertical plate may be rotatablerelative to the first vertical plate 705 to change an angle of a surfaceof a T-shaped structure 740 of the second vertical plate 706 relative tothe attachment plate 700 and base plate 900. Tightening of the screwsextending into the bores 730 may prevent, due to increased friction,further shifting of the second vertical plate 706 relative to the firstvertical plate 705 for changing the angle of the T-shaped structure 740relative to the attachment plate 700 and base plate 900.

The mounting plate 750 may include a T-shaped bore 752 which may extendthrough the length of the mounting plate 750 on an underside of themounting plate 750. The T-shaped structure 740 and the T-shaped bore 752may be formed in a form-fitting manner so that the mounting plate 750may be slid onto the second vertical plate 706 by extension of theT-shaped structure 740 through the T-shaped bore 752. It will beappreciated that other shapes may be used for the form-fitting structureof the vertical plate 706 and the bore of the mounting plate 750 whichwould allow for similar coupling of the mounting plate 750 to thevertical plate 706. The mounting plate 750 may further include bores 755which may extend to the T-shaped bore 752 in a direction perpendicularto the T-shaped bore 752. After the mounting plate 750 is slid onto thevertical plate 706 as described above, the set screws may be inserteduntil they form a significant compressive stress against the T-shapedstructure 740 to prevent further shifting of the mounting plate 750relative to the vertical plate 706, and thereby prevent disengagement ofthe mounting plate 750 from the second vertical plate 706.

A tested device 115 may be attached, e.g., via double-backed adhesivetape, to the mounting plate 750. The mounting plate 750 may then beattached to the vertical plate 706 as described above. The entirefixture 114 may be placed in the workstation, e.g., the mainworkstation, in a predetermined position relative thereto, e.g., whichmay be ensured by coupling legs extending downward from an underside ofthe device fixture 114 into receiving bores of the of the platform 104.Alternatively, the device fixture 114 may include a plurality of holes,e.g., four holes, e.g., one in each corner, that are press fit over acorresponding plurality of, e.g., four, custom posts with o-rings thatare mounted on the platform of the workstation. Once placed, a user maydetermine whether any adjustments need be made. Adjustments may includeshifting of the attachment plate 700 relative to the base plate 900,shifting of the base 702 within the window 710, and/or shifting of thesecond vertical plate 706 relative to the first vertical plate 705. Inparticular the angle of the second vertical plate 706 relative to theplatform 104 may be adjusted to ensure that the display screen of thetested device 115 is substantially parallel to the camera 113.

A tested device 115 may include buttons on a side face of the testeddevice 115 on a portion of the tested device 115 including the displayscreen, so that a depression direction of the button extends parallel toa plane of the surface of the display screen. When the robot 102depresses such a side button, a torquing force may be generated. Toprevent the tested device 115 to torque, under such a force, a post1000, e.g., as illustrated in FIG. 9, may be screwed into a bore 902 ofthe base plate 900 in a location such that the post 1000 contacts thetested device 115 at a side of the tested device 115 which is oppositethat of the side on which the side button is located. If side buttonsare located on both sides of the tested device 115, posts 1000 may beplaced on both sides. If no side buttons are included, posts may beomitted.

Those skilled in the art can appreciate from the foregoing descriptionthat the present invention may be implemented in a variety of forms, andthat the various embodiments may be implemented alone or in combination.Therefore, while the embodiments of the present invention have beendescribed in connection with particular examples thereof, the true scopeof the embodiments and/or methods of the present invention should not beso limited since other modifications will become apparent to the skilledpractitioner upon a study of the drawings, specification, and followingclaims.

What is claimed is:
 1. A device testing system, comprising: a memorystoring a plurality of screenshots associated with a device; a firstcamera; a second camera; a platform arranged such that at least aportion of the platform is in a field of view of the first camera and ina field of view of the second camera; a robotic arm; and a processorcoupled to the first and second cameras and to the memory; wherein: thefirst camera is arranged such that an axis that extends through a lensof the first camera extends approximately perpendicularly towards theplatform; the second camera is arranged such that an axis that extendsthrough a lens of the second camera extends at a substantiallynon-perpendicular angle towards the platform, and such that the secondcamera has a lesser zoom setting than the first camera, the secondcamera thereby sensing a greater viewing area than the first camera; thefirst camera is configured to transmit captured images to the processor;and the processor is configured to: cause the robotic arm to operate thedevice when the device is arranged on the platform; compare imagesreceived from the first camera during the operation of the device withthe stored plurality of screenshots; determine that an error hasoccurred if compared images do not match; and store in the memory avideo captured by the second camera during a time period during whichthe determined error occurred.
 2. The device testing system of claim 1,further comprising: a force sensor configured to sense a force generatedby the robotic arm; wherein: the operation of the device includesmanipulation of each of at least one of a subset of a plurality ofbuttons sufficient to cause generation in the device of a respectivesignal identifying the manipulation of the respective button; and foreach of the at least one of the subset of buttons, the manipulation isperformed by extending the robotic arm in the direction perpendicular tothe face of the respective button until a position of the robotic armcorresponds to a respective coordinate for the respective button.
 3. Thedevice testing system of claim 1, further comprising: a mini-workstationthat includes a camera arrangement, a processor, and a platformunderneath the camera arrangement, the mini-workstation not including arobotic arm via which the device is operable; wherein the operation ofthe device is based on the screenshots of the display screen to whichthe captured images are compared during the operation of the device. 4.A device testing method, comprising: operating a device according totest sequences, wherein a memory storing a plurality of screenshots isassociated with the device and a processor, the processor coupled to afirst camera and a second camera and to the memory; capturing stillimages of a display screen of the device using the first camera having afield of view substantially occupied by the display screen and arrangedon a platform; capturing video images using the second camera having afield of view of the device such that at least a portion of the platformis in a field of view of the first camera and in a field of view of thesecond camera; transmitting the captured images from the first camera tothe processor; comparing, in a first comparison step, the captured stillimages received from the first camera during operation of the devicewith stored plurality of screenshots; determining whether an error hasoccurred based on the comparison; and conditional upon a determinationthat an error has occurred if compared images do not match, storing in amemory a video clip captured by the second camera and which correspondsto a time period during which the determined error occurred; wherein thefirst camera is arranged such that an axis that extends through a lensof the first camera extends approximately perpendicularly towards theplatform; and wherein the second camera is arranged such that an axisthat extends through a lens of the second camera extends at asubstantially non-perpendicular angle towards the platform, and suchthat the second camera has a lesser zoom setting than the first camera,the second camera thereby sensing a greater viewing area than the firstcamera.
 5. The device testing method of claim 4, further comprising:conditional upon the determination that the error has occurred, storingin the memory one or more of the captured still images.
 6. The devicetesting method of claim 4, wherein the time period begins at a startingtime prior to the occurrence of the error and ends at an ending timesubsequent to the occurrence of the error.
 7. The device testing methodof claim 4, further comprising: locating a code region within an imagethat is captured by one of the cameras in whose field of view is thedevice; processing the code region to obtain a code encoded in the coderegion; wherein the operation of the device is based at least in part onthe code.
 8. The device testing method of claim 7, wherein the code is abarcode.
 9. The device testing method of claim 4, further comprising:detecting a position of the display screen with respect to the field ofview of the first camera, the comparing step being performed inaccordance with the detected position.
 10. The device testing method ofclaim 7, further comprising: a processor automatically operating a lightfixture to produce light, during the step of locating the code region,at a first level; subsequent to the step of locating the code, theprocessor automatically operating the light fixture such that the lightfixture does not produce light during the step of detecting the positionof the display screen; and subsequent to the step of detecting theposition of the display screen, the processor automatically operatingthe light fixture to produce light, during the steps of capturing thestill and video images, at a second level.
 11. A hardware-implementednon-transitory computer-readable medium having stored thereoninstructions, which, when executed, cause a processor to perform adevice testing method, the method comprising: operating a deviceaccording to test sequences, wherein a memory storing a plurality ofscreenshots is associated with the device and a processor, the processorcoupled to a first camera and a second camera and to the memory;operating the first camera to capture still images of a display screenof the device, the first camera having a field of view substantiallyoccupied by the display screen and arranged on a platform; operating thesecond camera to capture video images, the second camera having a fieldof view of the device such that at least a portion of the platform is ina field of view of the first camera and in a field of view of the secondcamera; transmitting the captured images from the first camera to theprocessor; comparing, in a first comparison step, the captured stillimages received from the first camera during operation of the devicewith stored plurality of screenshots; determining whether an error hasoccurred based on the comparison; and conditional upon a determinationthat an error has occurred if compared images do not match, storing inat least one of a memory and a disk a video clip captured by the secondcamera and which corresponds to a time period during which thedetermined error occurred; wherein the first camera is arranged suchthat an axis that extends through a lens of the first camera extendsapproximately perpendicularly towards the platform; and wherein thesecond camera is arranged such that an axis that extends through a lensof the second camera extends at a substantially non-perpendicular angletowards the platform, and such that the second camera has a lesser zoomsetting than the first camera, the second camera thereby sensing agreater viewing area than the first camera.
 12. The device testingmethod of claim 4, wherein the test sequences are pre-stored.
 13. Thedevice testing method of claim 4, wherein one or more configurationfiles include the screenshots of the display screen to which thecaptured images are compared during operation of the device.
 14. Thedevice testing method of claim 13, wherein at least a portion of the oneor more configuration files is generatable by capturing the screenshotsusing the camera arrangement of the mini workstation.
 15. The devicetesting method of claim 4, further comprising: generating aconfiguration file in accordance with which the operation of the deviceis performed, the generation of the configuration file including, inaccordance with a file identifying a plurality of test tasks, for eachidentified test task: outputting a prompt for information identifying arespective set of device operation sequences usable to perform therespective task; and responsive to information received for the prompt,updating the configuration file to include the received information.